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Abstract 

We prove that the Aizenman-Contucci relations, well known for 
fully connected spin glasses, hold in diluted spin glasses as well. 
We also prove more general constraints in the same spirit for multi- 
overlaps, systematically confirming and expanding previous results. 
The strategy we employ makes no use of self-averaging, and allows 
us to generate hierarchically all such relations within the framework 
of Random Multi-Overlap Structures. The basic idea is to study, for 
these structures, the consequences of the closely related concepts of 
stochastic stability, quasi-stationarity under random shifts, factor- 
ization of the trial free energy. The very simple technique allows us 
to prove also the phase transition for the overlap: it remains strictly 
positive (in average) below the critical temperature if a suitable ex- 
ternal field is first applied and then removed in the thermodynamic 
limit. We also deduce, from a cavity approach, the general form 



'King's College London, Department of Mathematics, Strand, London WC2R 2LS, 
United Kingdom, and Dipartimento di Fisica, Universita di Roma "La Sapienza" Piaz- 
zale Aldo Moro 2, 00185 Roma, Italy, <Adriano.BarraOromal.infn.it> 

tlCTP, Strada Costiera 11, 34014 Trieste, Italy, <lde_sancaictp . it> 



1 



of the constraints on the distribution of multi-overlaps found within 
Quasi-Stationary Random Multi-Overlap Structures. 

Key words: Disordered Systems and Glassy Matter, Exact Results. 

1 Introduction 

Dilute spin glasses are studied mostly for two reasons: their finite connec- 
tivity makes them in a certain sense close to finite-dimensional systems, 
while retaining a mean-field character; and they are mathematically equiv- 
alent to some important random optimization problems (such as X-OR- 
SAT and K-SAT [17]). The proper setting for the study of mean field 
dilute spin glasses are the Random Multi-Overlap Structures (RaMOSt), 
and the whole physics behavior of dilute spin glasses is carried by the prob- 
ability distribution of the multi-overlaps [8], which play the same role as 
the 2-overlap does for fully connected models. In the case of the latter, it is 
known that the Ghirlanda-Guerra identities [13] allow for the computation 
of the critical exponents governing the critical behavior of the 2-overlap 
[I] , and guarantee that the 2-overlap is positive below the critical temper- 
ature [I7j. The relations due to Aizenman and Contucci [2], on the other 
hand, imply lj that the expectation of the 2-overlap is strictly positive 
below the critical temperature (due to a phase transition triggered by an 
external field). Ghirlanda-Guerra identities are a consequence of the self- 
averaging of the energy density, and extend to dilute spin glasses, where 
one can also find more general relations for multi-overlaps [TU]. By con- 
trast, Aizenman-Contucci (AC) relations are a consequence of stochastic 
stability [2j[6], but they also follow from a certain kind of self-averaging, as 
shown by Franz et al. [11], who extended the AC relations to dilute spin 
glasses and multi-overlaps. In this paper we provide a new proof of the AC 
relations for dilute spin glasses, and of their generalized version for multi- 
overlaps. We emphasize that stochastic stability (and similar concepts) are 
intimately related to self-averaging properties. Moreover, both approaches 
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can be used with observable of various forms, not just the with the energy. 
The joint use of the techniques developed in 1 within the approach de- 
veloped in [H] is at the basis of the present work. The latter is organized 
as follows. The next two sections introduce the model and our notations, 
and illustrate the cavity perspective which the RaMOSt approach relies on. 
In section 0] we show that simple symmetry arguments within the cavity 
method lead to the proof of the phase transition of the expectation of the 
overlap: below its critical temperature the overlap remains strictly positive, 
if an external (cavity) field is applied and then removed in the thermody- 
namic limit. Section [5] is devoted to a proof that AC relations hold in 
dilute glasses, along with relations in the same spirit for multi-overlaps. 
We have already stressed that our proof is radically different from the one 
hinted at in [11] . Section [6] presents the form of the derivative with re- 
spect to a perturbing parameter of the expectation of a generic function of 
some replicas. The result makes it possible to develop systematically the 
constraints on multi-overlaps, whose critical behavior control can be here 
improved as compared to section [4] (although the critical exponents are not 
found yet). The straightforward but tedious and long calculations needed 
in some expansions are reported in the appendices, preceded by concluding 
remarks. 

2 Model and notation 

Consider iV points, indexed by latin letters i,j, etc., with an Ising spin 
attached to each of them, so to have spin configurations 

a ; {l,...,N} 9 i-> Oi = ±1 . 

Hence we may consider er e {—1,+1} N . Let be a Poisson random 
variable of mean £, let {J u } be independent identically distributed copies of 
a random variable J with symmetric distribution. For the sake of simplicity 
we will assume J = ±1, without loss of generality [15] . We want to consider 
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randomly chosen points, we therefore introduce as independent 

identically distributed random variables, with uniform distribution over 
1, . . . ,N. Assuming there is no external field, the Hamiltonian of the Viana- 
Bray (VB) model for dilute mean field spin glass is the following symmetric 
random variable 

P aN 

H N (a, a;J) = — ^ JvOi v aj v , a e M + . 

v=\ 

E will be the expectation with respect to all the (quenched) variables, 
i.e. all the random variables except the spins, collectively denoted by J . 
The non-negative parameter a is called degree of connectivity. The Gibbs 
measure lj is defined by 

for any observable tp : {— 1, +1} — > R, and clearly 

(7 

which is the well known partition function. When dealing with more than 
one configuration, the product Gibbs measure is denoted by fi, and various 
configuration taken from the each product space are called "replicas" . As 
already done above, we will often omit the dependence on /3 and on the 
size of the system N of various quantities. In general, we will commit some 
slight notational abuses to lighten the expressions when there is no risk of 
confusion. The free energy density /jv is defined by 

-pf N (/3) = ^mnZ N (P) . 

The whole physical behavior of the model is encoded by [8] the even 
multi-overlaps q\...2m which are functions of several configurations 
defined by 

i N 

«1...2n = J^l^^i a * ■ 
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3 Cavity approach and Random Mult i- Overlap 
Structures 



The thermodynamic limit of the free energy density exists if and only if the 
sequence of the increments (due to the addition of a particle to the system) 
is convergent in the Cesaro sense (indicated by a boldface C): 

lim —E\nZ M = lim — VEln-^±i = C lim Eln-^±1. 

M^oo M M->ao M ^ Z n M-»oo Zm 

n—0 

The idea at the basis of the cavity approach is in fact to measure the effect 
on the free energy of the addition of one spin to the system (see [3] for a 
beautiful summary). Let us denote the given M spins by r, as we want to 
save the symbol a for the added spin(s). Now, following [5], we can write, 
in distribution, 

M+l M + l 

v=l v=\ 

where we have neglected a term which does not contribute when M is 
large [8], {J v } are independent copies of J; {k^}, {m„}, and {/„} are 
independent random variables all uniformly distributed over {1, . . . , M}; 

are independent random variables uniformly distributed over the set 
{1, . . . , JV = 1}, consisting of {1} only. So Oi v = o\. Notice that we can 
also write, in distribution, 

H m +i(t, a; a) ~ H m (t; a') + h T o x (2) 

where 

it' = a 

M + l 

Notice also that similarly 

H M (r;a) = H M {r;a! ,J) + H m {t;q! /M,J) , (3) 



a = a , -i i h r = ~2^i J u T k„ 
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thanks to the additivity property of Poisson variables, and the two Hamil- 
tonians in the right hand side have independent quenched random variables 
J, J. Hence, if we call 

p a , 

H ai (t; a'/M, J) = H T (a') = - Xr K Ti„ , 

then 

„, Z M +i E T ,airexp{-(3h T a) 
It, m = E In ; , 

z M j: t z t cm-ph t ) 

with 

£ T = exp(-/3H M (T;a')) . 

As elegantly explained in [4], this equation expresses the incremental con- 
tribution to the free energy in terms of the mean free energy of a particle (a 
spin) added to a reservoir whose internal state is described by (r, £ T ), cor- 
rected by an inverse- fugacity term H, which encodes a connectivity shift. 
The latter may be thought of as the free energy of a "place holder": the 
cavity into which the (M + l)st particle is added. One may note that the 
addition of a particle to the reservoir of M particles has an effect on the 
state of the reservoir. For M >> 1, the value of the added spin, er, does 
not affect significantly the field which would exist for the next increment 
in M . Hence, for the next addition of a particle we may continue to regard 
the state of the reservoir as given by just the configuration r. However, 
the weight of the configuration (which is still to be normalized to yield its 
probability) undergoes the change: 

This transformation is called cavity dynamics. 

When we add more particles to the system, they do not interact, as 
there will just be copies of the cavity fields h % acting paramagnetically 
on each added spin (see [8] for details). Therefore if we add infinitely 
many particles (to an already infinite reservoir), we can replace the initial 
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complicated model with a simpler (at least in principle) paramagnet. The 
reasoning just illustrated thus paves the way to the proper concept to 
introduce for the computation of the free energy [H] . 

Definition 1 Given a probability space {fi, fi(du:)}, a Random Multi- 
Overlap Structure 1Z is a triple (£,{<72n},£) where 

• S is a discrete space; 

• £ : £ — > R + is a system of random weights, such that X) 7 es £7 — 00 
fi-almost surely; 

• fan '■ S 2n ->R,n€Nisa positive semi-definite Multi-Overlap Kernel 
(equal to 1 on the diagonal of £ 2 ", so that by Schwartz inequality 

l?l < 1;. 

By looking at the properties of h,H in (J2j)- (J3J) , we know that when many 
particles (say N) are added to the system, we need [5] in general N + 1 
random variables {hL(a; J)}fL 1 and H 7 (a; J), 7 S S, such that 



^Eln]T£ 7 exp(-/^;) = 2^^-tanh 2 "(/3)(l-(9 2 „)) (4) 

7GS n>0 

A E ln^^exp(-^ 7 ) = £i-tanh 2 "(/?)(l-(g 2 J). (5) 

7SE n>0 

These are the fields to plug into the "trial pressure" (— /3/jv(/3)) 

Giv(^) = -Eln — — - • (6) 

The Boltzmann RaMOSt [5] is the one we started from, constructed by 
thinking of a reservoir of M spins r 

M 

E = {-1, 1} M 9 r , £ T = exp(-/3ff M (r)) , &... 3 „ = — £ 
with 

/£(<*) = ^ J> 4 , # T (aiV) = - 2 J^r; 



T « ... r ( 2 ") 
fc=i 



p 2q p„ 



i/=i 
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and all the J's are independent copies of J, independent of any other copy. 

The next theorem will not be used, but it justifies the whole machinery 
described so far. 

Theorem 1 (Extended Variational Principle) Infimizing for each N 
separately the trial function Gn(TZ) over the whole RaMOSt space, the 
resulting sequence tends to the limiting pressure —f3f of the VB model as 
N tends to infinity: 

-/3f = lim inf G N (1Z) . 

A RaMOSt K is said to be optimal if G{K) = -/3f([3) V [3. We will 
denote by the measure associated with the RaMOSt weights £ as well. 

Is it possible to show [8j that optimal RaMOSt's enjoy the same fac- 
torization property enjoyed by the Boltzmann RaMOSt, described in the 
next 

Theorem 2 (Factorization of optimal RaMOSt's) In the whole re- 
gion where the parameters are uniquely defined, the following Cesaro limit 
is linear in N and a 

CUmElnn M {ci • • • c N exp[-(3H(a)}} = N(-(3f + uA) + aA , 

where ci = 2 cosh(/W) ; 

n— 1 

and the averages in both sides of the equation are assumed to taken by 
means of weights at connectivity a. 

As we extended the use of 51 from the Gibbs measure to any RaMOSt mea- 
sure, we are clearly extending to any RaMOSt the notation Efi(-) = (•) 
too. We will use only part of the previous theorem, or more precisely a 
modification of the part involving the inverse fugacity only. Notice that in 
the definition ([6]) of the trial pressure G the part with the cavity fields and 
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the part with the inverse fugacity are taken already factorized (the inverse 
fugacity appears at the denominator). If we therefore focus on the fugacity 
part only in the theorem above, by setting all the cavity fields h l to zero, 
the property described in Theorem [5] becomes what is often called stochas- 
tic stability (of the measure f2 with respect to the perturbation H ) , which 
we will prove and exploit in Section [5] It should be now clear, from the 
construction described about equations (HJ)-©, that this perturbation can 
be either due to the addition of N particles, or due to a connectivity shift, 
and leads to a linear response of the free energy. Hence the theorem above 
combines two invariance properties of the optimal RaMOSt measure VL: the 
one of the cavity part with respect to the cavity dynamics, and the one of 
the fugacity part with respect to connectivity shifts. The invariance with 
respect to the cavity dynamics is a special case of Quasi-Stationarity, i.e. 
the invariance up to a correcting factor under random shifts (see [3J 0] for a 
detailed introduction). The Parisi ultrametric Ansatz, both for dilute and 
for fully connected Gaussian models [T7] , is based on Hierarchical Random 
Probability Cascades, which exhibit the Quasi-Stationarity of the General- 
ized Random Energy Model [4j [TT] . A very stimulating conjecture is that 
Random Probability Cascades include all the quasi-stationary structures. 

As an aside remark, we point out that for stochastically stable systems, 
a dynamical order parameter can be defined and related to the static order 
parameter. Ultrametricity in the dynamics implies static ultrametricity, 
which is in turn implied by so-called separability, and connected to the 
idea of overalp equivalence. We refer to [121 1161 110] for details, here we 
just wish to stress that all these concepts and the one of self-averaging are 
intimately related, and have deep physical meanings. 

4 Non-negativity of the average of mult i- over laps 

We know from (9[ [15] that above the critical temperature j3 c all the multi- 
overlaps (including the 2-overlap) are identically zero, as the replica sym- 
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metric solution holds. We also know, from [TS], that the (rescaled) 2-overlap 
shows diverging fluctuations at the critical temperature (3 C where the replica 
symmetry is broken, while the (rescaled) multi-overlaps of more than two 
replicas do not exhibit diverging fluctuations at this inverse temperature. 
If the expression of the fluctuations of the rescaled multi-overlaps given in 
|15j could be proven to be valid down to suitable lower temperatures, we 
would have what is physically a common belief [T5], i.e. that the critical 
temperature /3i 2n ^ at which the fluctuations of t/N q2 n diverge is given by 

tanh 2 "(/3( 2 ™)) = -L , a >\ . 

let I 

So that q2n would be zero up to /?c 2 ™\ where it would start its concave 
increase toward 1 as (3 — ► oo. 

We want to show that the 2-overlap exhibit the same phase transition as 
in the Gaussian SK model lj : if we apply an external field and then remove 
it in the thermodynamic limit, the 2-overlap remains strictly positive below 
its critical temperature, where its variance becomes non-zero. The same is 
expected to hold for all multi-overlaps. 

Let us introduce the following notation: lo & {-) , (-) a denote the usual 
expectations except for a perturbation in the Boltzmannfaktor, which is 
assumed here to be 



exp 



n , pi 

-p(H N {a;a) - ]T ( £ 4 U 



i.e. the initial Boltzmannfaktor is perturbed with independent copies of an 
external field h(ct) = X)T=i ^ v modulated by a. 
This section is devoted to the next 



Theorem 3 The following holds: 
1. for any inverse temperature f3 



lira (gi 2 )a=2a/jv > 
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2. for any (3 > (3 ( c\ defined by 2a tanh 2 (/3? } ) = 1, 

lim (gi 2 ) a= 2a/jv > . 

We will see that our method would imply immediately the analogous state- 
ment for all multi-overlaps, should the formula for their fluctuation be 
proven to hold at lower temperatures as well. 

The theorem will be a simple consequence of two lemmas, which require 
a definition as well. 

Lemma 1 Consider the set of indices .., i r }, with r G [1, N]. Then 

lim U}N,a(°~ii ■ • '°»J = ^iV+l(0ii • • -O-ir^N+l) + O(-) , 

a—>2a/N JM 

where r is an exponent (not a replica index) and we have made explicit the 
dependence of u> on the size of the system. 

This lemma is a consequence of the fact that with the chosen a the pres- 
ence of the external field is equivalent to the introduction of an additional 
particle, labelled TV + 1. This should be clear from CO)-© and from the 
gauge symmetry with respect to the transformation er^ — > Uia^ + i, but the 
reader may want to refer to Lemma [T] in pQ for details. We do not need 
here the most general version of the formalism presented there, and limit 
ourselves to the following 

Definition 2 A polynomial function of some overlaps is called 

• filled if every replica appears an even number of times in it; 

• fillable if it can be made filled by multiplying it by exactly one multi- 
overlap of appropriately chosen replicas; 

The next lemma is a consequence of the previous one, where the exponent 
r is always even for filled polynomials. 
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Lemma 2 In the N — > oo limit the average (-) a of filled polynomials is 
not affected by the presence of the perturbation modulated by a, that is, for 
instance, 

/ (<7l2<?239l3)a<*5 = / (<7l2<?23?13)rfa , 

for any interval [cti , 0:2] • 

Recall that the Gibbs measure in case of several replicas is the product 
measure, and that the perturbation given by a is equivalent to the addi- 
tion of a new spin to the system, up to neglibile terms vanishing in the 
thermodynamic limit. So if we consider in Lemma [1] for a filled polyno- 
mial of replicas, then we have the product of several Gibbs expectations, 
in each of which the added spin appears with the exponent r even, being 
thus uncffcctivc. 

We are not going to use this lemma in its full generality, we will use it 
only in the case where the filled polynomial is a squared multi-overlap. At 
least in this case, as the free energy is a series with averaged squared multi- 
overlaps, the regularity of the free energy is equivalent to the fact that the 
pertubed averages of squared multi-overlaps tend to the unperturbed ones. 
This is discussed in J2JEJ03] but also in Lemma[3]from next section, and the 
key concept is always the convexity of the free energy in the connectivity. 

We will refer to statements, like the one in the Lemma above, true only 
taking the integral, as valid in a-average, and we will omit to write the 
integral. From the previous lemma we will deduce the next 

Proposition 1 Let Q\...m be a fillable polynomial of the overlaps, such 
that qi...2nQl—2n * s filled. Then 

lim (Ql...2n)a=2a/N = \Ql---2nQl— 2n) j 

where the right hand side is understood to be evaluated in the thermody- 
namic limit. 
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Proof. Let us assume for a generic overlap correlation function Q, of s 
replicas, the following representation 

a=l if 1=1 

where a labels the replicas, the internal productory takes into account the 
spins (labelled by I) which contribute to the a-part of the overlap q a<a i and 
runs to the number of time that the replica a appears in Q, the external 
productory takes into account all the contributions of the internal one and 
the I factor fixes the constraints among different replicas in Q; so, for 
example, Q = (712923 can be decomposed in this form noting that s = 3, 
n 1 = n 3 — 1, n 2 = 2, I = N^S^ qSq q, where the S functions fixes the 
links between replicas 1,2 — > and 2,3 — > (72,3- The averaged overlap 
correlation function is 

(Q)=E 7 (W})fl^(fl<?)- 

if a—1 1=1 

Now if Q is a tillable polynomial, and we evaluate it at a = 2a/ TV, let us 
decompose it, using the factorization of the co state on different replica, as 

u n a s n b 

(Q) = e /({i?}, n ^(Q 4) n ««>(n <%)> 

if,tf o=l 1=1 b=u 1=1 

where u stands for the number of the unfilled replicas inside the expression 
of Q. So we split the measure fi into two different subset co a and uib: in 
this way the replica belonging to the b subset are always in even number, 
while the ones in the a subset are always odds. Applying the gauge af — > 
cfcr^ +1 , Vi G (1, N) the even measure is unaffected by this transformation 
{Pn+i = 1) wnue the odd measure takes a er/v+i inside the Boltzmann 
measure (Lemma 1,2). 

a b 
U TL S Tt 

(Q) = e j (w}> n ^(^+1 n 4) n <^+i n 4) 

if, if o=l 1=1 b=u 1=1 
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At the end we can replace in the last expression the subindex TV + 1 of 
<7n+i by k for any k ^ {if} and multiply by one as 1 = N^ 1 J^ fc _ Q . Up to 
orders 0(1/N), which go to zero in the thermodynamic limit, we have the 
proof □. 

At this point the first part of Theorem [3] is simply a corollary of this 
proposition in the case Q = q, and of the fact that all multi-overlaps 

( 21 

(including the 2-overlap) are zero above the critical temperature l//3c , 

and the 2-overlap starts fluctuating below, so that is strictly positive 

and coincides (in the limit) with (92) by Proposition [T] The fact that (gf) 

(2) 

is strictly positive for p > f3 c is obvious from the fact that the replica 
symmetric solution does not hold in this region |15j . 

We will discuss the generalization of Theorem [3] to multi-overlaps in [7]. 

5 Stability relations from Quasi-Stationarity 

In this section we want to prove the following 

Theorem 4 The consequences of stochastic stability in fully connected 
models extend to dilute spin glasses, and constraints analogous to those 
found for overlaps of two replicas only hold for multi-overlaps. More pre- 
cisely, 

1. the Aizenman-Contucci relations hold in dilute spin glasses. A first 
example is 

{1I2I13) = 4(912) + 4(912^4) ; 

2. further relations for multi-overlaps hold in dilute spin glasses. A first 
example is 

(91234915) = ^(9l2349l2) + g (91234956) ■ 

We start addressing the proof of the theorem by proving a lemma that 
gives the explicit form of the contribution to the free energy of a connec- 
tivity shift. 
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Lemma 3 Let f2 , (•) be the usual Gibbs and quenched Gibbs expectations 
at inverse temperature (3, associated with the Hamiltonian Hn(o~,cc,S). 
Then, in the whole region where the parameters are uniquely defined 

/ \ 00 1 

to E In n exp ^ fan en =c«'^- tanh 2 " {fit) (1 - (g 2 2 n » , (8) 

^ i/=l ' n=l 

where the random variables P a ',{J^}, {i' u },{j' v } are independent copies of 
the analogous random variables appearing in the Hamiltonian in f2. 

Notice that, in distribution 

PaN P a > P ( a + o,'/N)N 

V— 1 V— 1 V— 1 

where {J"} are independent copies of J with probability aN/(aN + a') 
and independent copies of J(3' / j3 with probability a' /{ctN + a'). In the 
right hand side above, the quenched random variables will be collectively 
denoted by J" . Notice also that the sum of Poisson random variables is 
a Poisson random variable with mean equal to the sum of the means, and 
hence we can write 

V rr-. r, , \ : " In L 

Z N (a;J) 
where we defined, for t 6 [0, 1], 

a t = a+a'— (11) 
so that at — > a V t as N — > 00. 

Proof. Let us compute the i-derivative of A t , as defined in (TIT)]) 

d °° d { m 

—A t e Y dt 77a ' t ^ ln 5Z exp ( ft J v ai 'u a ii 

m—l (7 ^ 1/— 1 

Using the following elementary property of the Poisson measure 

J^tcM = C(7r tc (m - 1) - 7T tc (m)) (12) 



A t ee ElnQexp ( £ J^^) = Eln^^ , (10) 
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we get 

d x m 

—A t = a'E [7r a / t (m - 1) - 7iy t (m)] ln^ exp^ J' v o~i' u o~j> v ) 

m— cr v— 1 

= a'Eln^exp(/3'J'cr C CT^)exp(/3' ^ J' v ^j'„) 

p a > t 

-a'E In ^ exp(/?' ^ J' v a Vv a fv ) 

a f—1 

= a'Eln^texp^'J'cr^fjjvJ , 

where we included the i-dependent weights in the average fit ■ Now use the 
following identity 

exp(/3' J'aiijj) = cosh(/?'J') + a % a 3 sinh(/3'J') 

to get 

j- At = a'Elnfi t [cosh(/3'J')(l + ta,nh([3' J')a iL a r J] . 
It is clear that 

so we now expand the logarithm in power series and see that, in the limit of 
large N, as at —* a the result does not depend on t, everywhere the measure 
(■}t is continuous as a function of the parameter t. From the comments that 
preceded the current proof, formalized in ([9|)- (ll0p - (fTT|) . this is the same as 
assuming that £1 is regular as a function of a, because J" — > J in the sense 
that in the large ./V limit J" can only take the usual values ±1 since the 
probability of being ±/3'//3 becomes zero. Therefore integrating over t from 
to 1 is the same as multiplying by 1. Due to the symmetric distribution 
of J, the expansion of the logarithm yields the right hand side of ©, where 
the odd powers are missing. □ 

Remark 1 The same result holds for the hierarchical Parisi trial structure 
JB/. In general, what we study in this section relies only on that holds 
for quasi- stationary RaMOSt's, to which our results therefore extend. 
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Proof of Theorem [4j Consider once again 

p a , 

i/=i 

We will let again fl be the infinite volume Gibbs measure associated with 
the VB Hamiltonian at connectivity a and inverse temperature (3. 
Due to the symmetry of O, we have [5] 

Elnfiexp(/3'i?) = -Elnfiexpf-^^F - #')) > 

where we "replicated" if' = H{a'). 

For the left hand side of ©, a tedious expansion yields 

-\nnexp(-[3'(H - H')) = 

/3' 2 ~[2Q(H 2 )-2n 2 (H)} + 

I3 ,4 ^[Q{H 4 ) - AQ(H 3 )Q(H) - 3Q 2 (H 2 ) + 12Q{H 2 )Q 2 {H) - 6Q 4 {H)\ + 

p m [^m 6 ) - ±m 5 MH) - ±m 4 MH 2 ) - ±q 2 (h 3 ) 

+±n(HMH 2 MH :i ) + ±n 3 (H 2 ) + io 2 (ff)fi(£ 4 ) \m^{H) 
~n 2 (H)n 2 (H 2 ) + ±n(H 2 )n 4 (ii) - ^(h)} + o(p' 8 ) , 

of which we have to take the quenched expectation E, using the formulas in 
Appendix[Al For the right hand side of |(HJ), the expansion of the hyperbolic 
tangent, performed explicitly for convenience in Appendix [SI leads to 



a '£ JL tanh 2 "(/3')(l-(g?... 2 J) = 



2n 

P a ^{\-\{ql 2 )) + 

^{~ + \{ql 2 )-\{ql 2 ^)) + 

(3' 6 a'(^ - ^(q 2 12 ) + \{ql^) i<9?23456» + 0(/3' 8 ) 

Recall that the averages (•) do not depend on /?', so we now have two 
power series in /?' that we can equate term by term. The order zero and 
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the odd orders are absent on both sides. Let us consider the second or- 
der. Taking into account the formulas given in Appendix ^ we have two 
identical (constant) monomials in a! 

5(1 -<<7? 2 » = 5(1 -<9? 2 » 

and we gain no information. Let us move on to order four: using again the 
formulas given in Appendix we have the equality of two polynomials of 
degree two in a' . There is no constant term, and no second power in the 
right hand side. Equating term by term we get a trivial identity for the 
linear part in a' (and hence no information). From the quadratic term in 
a! ', on the other hand, we obtain the following relation 

(W = \{<Ai) + \{<Z2<&a) (14) 

which is the first AC relation we wanted to prove. 

Notice that in the linear part in a! a multi-overlap is present: (71234, but 
it cancels. By contrast, in the quadratic part only 2-overlaps are present. 

Let us now focus on the sixth order. Again we get a useless identity 
from the linear part in a', from which 4-overlaps and 6-overlaps get canceled 
out, and we gain no information. From the quadratic part, where 4-overlaps 
are present (but no 6-overlaps are there), {q\ 2 ) disappears, while the other 
terms with 2-overlaps only cancel because of the previous AC relation. In 
fact, from the expansion we have 

15 15 , o \ ' 1 / 4 \ 1^ / 2 \ ' / 2 \ 
gj- - sfWia) - 4g - g W12) - 72<?ia) + g(?ia>+ 

^<9l2<Z2 2 3> + g + + ^<9l2> + ^1292 2 3> + J<<Zl2>- 

1 9 3 

2(9l234) - 2<«12?34> ~ g (<7 2 2> - 3 (9l2fe) - 2(912^1234) + 

^(91234) + 3(<7? 2 < 73 4 ) + 4 (<7l2'?2345) ~ ^ {ll2<il^) = ■ 

So we are left, after a few trivial calculations, with the following new rela- 
tion for multi-overlaps 

(9l234<7l5) = ^(<7 2 234<7l2) + 77 (<7l234<?56) ( 15 ) 



18 



announced in the statement of the theorem. 

In the cubic part in a' only overlaps of two replicas are present, and 
only the monomials of order six remain, as the ones of lower degree cancel 
out directly. The remaining relation is 



12 tel2> - (9?2?23> + |(<7l2<734> ~ 3 (?12«2393l) + 

(9? 2 9l39l4> + 3<g?2'?23<334> - 6(<7? 2 923945> + \ (<7l2<734956> = ■ 



Proceeding further, the expansion generates all the identities due to stochas- 
tic stability, in full agreement with the self-averaging identities found in 

HHUD]. □ 

We will provide a more general and systematic form of the relations in 
the next section. 

6 Stability relations from the cavity stream- 
ing equation 

In this section we study a family of constraints on the distribution of the 
overlaps. To address this task we will consider the quenched expectation 
of a generic function of s replicas, with respect to the perturbed measure 
with weights 



whose use will be indicated with a subscript t in the expectations. Once 
again, { J„} are independent copies of J. 

From now on let us put 9 = tanh(/3'), and, assuming J = ±1, we have 
6 2n = Etanh 2 "(^'J), tanh 2n+1 (/3'J) = Jd 2n+1 VneH. Let us also just 
put uit = wt(cr), with a slight abuse of notation. 



1 



3 



1 




(16) 
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Proposition 2 Let $ be a function of s replicas. Then the following cavity 
streaming equation holds 

AJl = _2a'<*) t + 2a'E[fi t ${l + J go* + E< ^0 2 + 

a a<6 

j E <«^ 3 + ---}{i- s j^ t + ^^^ 2 - 

a<6<c 

«(«+!)(« + 2) 3 3 



3! 



JO^i + •••}] Vfl (17) 



Proof. Let us explicitly perform the calculation of the derivative, using 

S P I Pi 

^EZ- 1 £ $exp(^(/3 J„« + /?' ^ J>? )) = 

fi t exp(/3'El =1 J<) ^ " 

2 >F fWU^MgV)+< sinh(/3'J))] 
" ^[n^iCcosh^'^ + a^sinh^'J))] " [ H 

2aE (TT^ 2a ($>t - 

Now note that 

1 s(s + 1)99 

T s(s+l)(s + 2) a3 3 .s( g + l)(.s + 2)(.s + 3) M 4 

^1 " w t "I 71 " u t — ' ' ' 

3! 4! 

and that 

S 1,5 1,S 1,S 



o=l a a <b a<b<c 

The theorem follows immediately. □ 

In the limit a' ~> 00 as (3' SK = 2a9 2 is kept constant, the powers of 9 
higher than two are killed, and we recover the equation for the Gaussian 
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SK model [5] 

d(®)t /(h( ^ ^ . s(s+l) 

a<b a 

If in the previous theorem we take a function <3> whose average does not 
depend on t, the left hand side of (|17p is zero, and we have a polynomial in 
9 (and hence in j3') on the right hand side that can be equated to zero term 
by term (we do not need to re-expand in f3' and equate the new coefficients 
to zero). We know from Lemma [2] that the left hand side of (|17p does not 
depend on t when, for instance, $ is a filled polynomial. If, in each term 
of the expansion that we equate to zero in this case, we additionally take 
t = l,a' = a, j3' = P, and let N — > oo, then we also guarantee that the 
fillablc polynomials get filled, thanks to Proposition [T] In other words 

Proposition 3 The generator of the constraints on the distribution of the 
overlap is: 

lim d t m t = 

N~> oo 

where $ is filled, and t = 1, a' = a,f3' = (3. 

Let us consider the first simple example, $ — q\ 2 . Proposition[5]thcn yields 



lim d t (q 2 12 ) t = lim (q 3 12 - Aq 2 2 q 23 + 3q 2 2 q 34 ) t 9 2 + 0(6 4 ) = 
lim (q 3 12 - 4q 2 12 q 23 + 3q 2 12 q 34 } t [3' 2 + 0(/3' 4 ) = 

iv— »oo 

=> (ll2 ~ 4 9l2<723 + ^Ql2lu) = > 

which is understood to be taken in the thermodynamic limit and is just the 
Aizenman-Contucci relation we have found already in the previous section. 
If we choose instead $ = q 2 23i , we obtain 

lim d t (q 2 234 )t = {0 2 (3g? 2 34«i2 ~ ^QuuQis + 10<?r234<7i5 2 ) + 

N— >oo 

4 (9l234- 16 9l2349l235+ 6 °9i^ = 
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From the order two in /?' we have the coefficient of 9 2 , and equating to zero 
gives 

(^234^5 ) = g(<Z?234<Z?2> + g^Wse) ■ 

At the order four in (3' we have leftover term from the order two, which 
thus vanish, and the coefficient of 9 4 : 

(9l234) — (16<7i2349i235 — 60gi234 ( ?1256 + 80<Zi234<?1567 ~ 35<J , i 2 34<2 , 5678) • 

In a similar way we can obtain all the other relations, from the higher 
orders, simply by equating to zero all the coefficients of the expansion in 
powers of with no need to expand in /?'. 

When $ = gf... s , notice that the relation we obtain from the lowest order 
in (jTTJ) is formally identical to equation (fT5)l . with zero on the left hand 
side, without the limit a' — ► 00. Hence, using the invariance with respect 
to permutations of replicas, we have the general form of the constraint of 
which (|14|l and (fT5|) are two special cases. In general, for a suitable function 
$i... s of s replicas, from Proposition [2] we can state 

Theorem 5 Given an even integer s, the AC relation 
holds. 

Subtracting the equation above from the well known Ghirlanda-Guerra 
identity [T3] 

= J(*i- S >(9?2> + ^-<*i-.«^i,. +2 ) 
we get the other well known relation 

($l... s 9 s 2 +1 , s+2 ) = j|- I <*l.-.)<«? 2 > + ^(^l-a9? 2 ) ■ (19) 

While the Ghirlanda-Guerra identities are a consequence of self-averaging, 
in the thermodynamic limit, of the energy density Hn/N = K 
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the AC relations are a consequence of stochastic stability; but they can 
also be deduced from a self-averaging relation: 

En{K<s> s ) = Erj(if)fi($ s ) . 

Clearly the third relation (JTSJ) is hence a consequence of 

EO(JsT)fi($ s ) = TO*-) • 

We stress that not only the energy density can be used to get the various 
relations, but several other quantities (as long as self-averaging is preserved) 
would do as well. 

If we consider 4-overlaps, Proposition [2] gives 
( S -l)(a-2)( S -3) , «(«-!)(« -2) , 

1] ^l-aSl, 2,3,4/ 3| V*l-s?l,2,3,s+l/ + 

(g - lMg + 1) 2 s(s + l)( S + 2) 2 

^ \*l-s«l,2,s+l,s+2/ gj \*l-s9l,s+l,s+2,s+3/ 

(.s + l)(.s + 2)( S + 3) 2 n 

which again can be deduced from a self-averaging relation too [TTJ [TU] and 
should be compared with the generalization of Ghirlanda-Guerra relations 

«(«-l)(«-2)(«-3) s( a -l)(s-2) 

g-j (91,2,3,4*) 2 Wl,2,3,s+lS > ) 

(s-l)s(s + l). s(s + l)(s + 2) 

H 2! Wl,2,»+l,s+2*; g-j Wl,s+l,s+2,s+3*/ 

+ (<Zl23 4 )($) = , 

which has been found in [TU] , as a consequence of the self-averaging of the 
energy density. 

We do not write explicitly the general form of the constraints deduced 
from Proposition [21 as it is a very simple but tedious computation, which 
shows that the relations are in agreement with . 



6.1 Revisiting the positivity of multi-overlaps 

We here hint at how to gain a better control of the phase transition dis- 
cussed in section |4j using the expansion of the cavity streaming equation, 
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to justify from a different perspective what is proven in [TS]: the fluctu- 
ations of the multi-overlaps diverge at lower temperatures as the number 
of replicas increases. This is a first step in the calculation of the critical 
exponents of the critical behavior of the multi-overlaps. We only sketch 
the arguments, which proceed along the lines described in pQ. 

We are going to prove that the first contribution to the average of the 2- 
overlap in its tanh(/3') = 9 expansion is of order two, while it is of order four 
for the 4-overlap, and so on for higher order multi-overlaps, as intuitively 
expected. 

Let us write the streaming equation for ((712)4, with j3 r = j3, a' = a 

d t {qi2)t = a0 2 {q\ 2 - 4(ji2g23 + 3912934)* + O{0 4 ) . 

But (qf 2 )t = (#12) because q\ 2 is a filled monomial, and it can be integrated 
offering 

(q 12 ) t = a9 2 (q 2 12 )t + ad 2 f dt(-A(q 12 q 23 ) t + 3(q 12 qu)t) + 0{9 4 ) . 
Jo 

We now prove that the terms inside the integral arc of higher order in 8. 
It is enough to notice that such terms are fillable but not filled, so we can 
expand them using the streaming equation to evaluate the leading order at 
which they contribute, which is 9 3 as can be deduced from the expansions 
given in Appendix [B] The same approach can be used for the 4-overlap; in 
fact we can write 

9t(?1234>t = Ol8 2 (10^1234956 ~ 16gi2349l5 + 6gi 2 349l2)t + 
a ^ 4 (9l234~ 16 9l234gi235 + 60gi2349l256-80gi2349l567-35gi234g5678)t + O(6» 6 ) 

It can be readily seen that the only contribution at the fourth order is due 
to (^1234), given that this is the only filled monomial. The calculations in 
Appendix [B] show that the three contributions from the second order in 8 
(i.e. 91234956, 91234915, 91234912) contribute at orders higher than four, so 
the first term in the four-replica multi-overlap expansion is positive (being 
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a square), in agreement with what we showed in section [U We notice that, 
while the first contribution to the 2-overlap is of order two in 9, the first 
contribution to the 4-overlap is of order four, and this result extends anal- 
ogously to the higher order multi-overlaps. So it is not surprising that at 
the point where the 2-overlap fluctuations start diverging, the fluctuations 
of the 4-overlap do not, and so on for higher orders, in agreement with 
what is proven in |15j . 

7 Conclusion and outlook 

We have proven the validity of Aizenman-Contucci relations for dilute spin 
glasses and exhibited further relations for multi-overlaps. Some more gen- 
eral relations can be found with the same stochastic stability methods for 
internal energy, but also from the cavity part of the RaMOSt trial function, 
by means of a control of the response of the average of generic observables 
with respect to the change of a perturbing parameter. We also showed 
that the multi-overlaps undergo the same transition the 2-overlap exhibits 
in fully connected models, i.e. they remain strictly positive, below the crit- 
ical temperature, if we apply an external field and then remove it in the 
thermodynamic limit. The external field is properly modulated, in diluted 
systems, by the degree of connectivity of the perturbation. 

The further natural development is the study of the extension to multi- 
overlaps of the self-averaging identities (known as Ghirlanda-Guerra in fully 
connected models) to prove that even multi-overlaps are non-negative with 
probability one in dilute spin glasses (the identities will be derived in [TP]). 
This would extend to odd-spin interactions the replica bounds so far rigor- 
ously valid only for even interactions, and such a result would be important 
for the application of dilute spin glasses to optimization problems like the 
K-SAT. 

Another development of the current work is the calculation of the crit- 
ical exponents of the multi-overlaps, which has been gained for fully con- 
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nected models in [T] with the same techniques here shown to be fruitful 
in dilute models too. We will report on critical exponents in dilute spin 
glasses soon, in [7J. 

A Formulas for the RaMOSt expansions 

Let us report for convenience the well known expansion 

tanhOzO^T— (2 2n - l)B 2n x 2n - 1 
where B n and the Bernoulli numbers, defined by 

so that 

We also report here the result the computation below, that we used in 
the expansions of the previous sections. 
Order two: 

EQ(H 2 ) = a' 
EQ 2 {H)=a'(q 2 l2 ) 

Order four: 

ED(# 4 ) =a' + a 2 3 

m(H 3 MH) = a'(q 2 2 )+a' 2 3(q 2 2 ) 

En 2 {H 2 ) = a' + a' 2 (l + 2(q* 2 )) 

En(H 2 )n 2 (H) = a'(q 2 12 ) + a' 2 ((q 2 12 ) + 2(q 2 12 q 2 13 )) 

En i (H)=a'(q 2 234 )+a' 2 3(qj 2 q 2 4 ) 
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Order six: 



En(H 6 ) = a' + a' 2 lb + a' 3 l5 

Eil(H 5 MH) = a'(q 2 2 ) + a' 2 15(q 2 12 ) + a' 3 15(q 2 2 ) 
EQ{H 4 )Q{H 2 ) = a' + a' 2 (7 + 8{q$ 2 )) + a' 3 (3 + 12(q* 2 )) 
En 2 (H 3 ) = a'(q 2 2 ) + a' 2 15(q 2 12 ) + a' 3 (9(q 2 12 ) + 6<g? a » 
En(H)n(H 2 )n(H 3 ) = a'{q 2 l2 ) + a' 2 (7{q 2 12 ) + 8(q 2 12 q 2 23 )) 

+a /3 (3(q 2 12 )+6(q 2 12 q 2 13 )+6(q 2 12 qt 3 }) 
En 3 (H 2 ) = a' + a' 2 (3 + 12(qf 2 )) + a' 3 (l + 6(qf 2 ) + 8(q 2 12 q 2 3 q 2 31 )) 
Efi(ff 4 )fi 2 (iT) = a'(q 2 12 ) + a' 2 (7(q 2 12 ) + 8(q 2 12 q 2 23 )) 

+a' 3 (3(q 2 12 ) + 12(q 2 12 q 2 23 )) 
En 3 (H)Q(H 3 ) = a'{q 2 23A )+a' 2 {3{q 2 23i ) + 12(q 2 2 q 2 4 }) 

+^ 3 (9(q 2 12 q 2 3i )+G(ql2<l 2 2 3 <lli)) 
En 2 (H)n 2 (H 2 ) = a'(q 2 12 ) + a' 2 (3(q 2 12 ) + 8(q 2 12 q 2 23 ) + 4(g^ 234 » 

+a l3 {(q 2 2 ) + 2{q 2 2 q i 3i ) + 4(q 2 12 q 2 23 ) + 8{q 2 2 q 2 3 q 2 3i )) 

En(H 2 )n\H) = a'(q 2 123A ) + a' 2 ((q 2 1234 ) + 6(q 2 12 q 2 3A ) + 8(q 2 12 q 2 23A5 )) 
+«' 3 (3(< ? ? 2 g 3 2 4 ) + 12( (Z 2 2(Z 2 3(Z 2 5)) 

En 6 (H) = a'(q 2 23i56 ) + a' 2 l5(q 2 2 q 2 3i56 ) + a' 3 l5(q 2 2 q 2 3i q 2 6 ) 



B Formulas for the cavity expansions 

In this appendix the streaming equations for the expansion of section [5] 
follow: 
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dt{qi2)t = a0 2 (q 2 12 - 4q 12 q 2 3 + 3q 12 q 34 ) t + 0(9 4 ) 

d t (qi2q23)t = ad 2 (6^12^23945 - 6gi2<7239l4 - 3<7i2<723<724 + 912923913 
+ 29? 2 923> + a9 4 (15qi292394567 - 2091292391456 - 1091292392456 
+ 1291292391245 + 6^1292391345 - 3<7i 2 9239l234)t + O(0 6 ) 

9 t (9l2934)t = a9 2 (10912934956 - 16912934915 + 29i 2 934 + 4gi29349l3)t 
+a9 i (35^1293495678 - 80gi2934 91567 + 20^1293491256 + 4091293491356 

-I691293491235 + 91293491234)* + 0(9 6 ) 

d t (qi234)t = "^(1091234956 - 1691234915 + 691234912)* + a# 4 (9i234 
-169123491235 + 609123491256 - 809123491567 - 359123495678 )t + 0(9 6 ) 

94(9l2349l2)t = ^ 2 (109l2349l2956 - 8^1234912915 
-891234912935 + 91234912 + 591234912913)4 + af? 4 (359i2349l295678 
-409123491291567 - 40<7i 23 49l2 93567 + 109l2349l29l256 + 40(7i 23 49l29l356 
+ 109123491293456 - 169l2349l29l235 + 9l2349l2)4 + 0(9 & ) 

94(91234915)4 = u9 2 (15qi2349l5967 - 1591234915926 - 1091234915956 
+ 591234915912 + 4(71234915923 + 9l2349 2 5 )4 + O!0 4 (7O9i2349l596789 
-105(7123491592678 - 70gi 23 49l59l678 + 159l2349l59l567 + 90<7i 2 349l59l267 
+45<7i2349l5 92367 + 20<7i2349l59l235 — 25(?i2349l59l246 
-59123491592346 + 4^123491591236 + 9l2349l5)t + 0(9 6 ) 

94(91234956)4 = a9 2 (21(71234956978 - 24<7i2349569l7 

-12^1234956957 + 6<7i2349569l2 + 891234956957 + 91234956) 

+a9 4 (126(7123495697890 - H29123495695789 ~ 224gi 23 49569l789 

+ 21(7123495695678 + 168(7123495691578 + 126^123495691378 — 24<7i 2 3495693567 

+ 149123495691235 + 9l23495e)4 + 0(9 6 ) 
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